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AUTOMATIC  DETECTION  OF  GULF  STREAM  RINGS 
M.  F.  Janowitz 

1.  Introduction.  Cold-core  rings  are  hydrographical ly  distinguishable 
physical  features  that  are  spawned  by  meanders  from  the  Gulf  Stream.  Ty¬ 
pically,  they  are  150-300  km.  in  diameter,  are  roughly  elliptical  in  shape 
and  represent  intrusions  of  cold  water  into  the  Sargasso  Sea.  Their  boundary 
is  similar  to  the  South  Wall  of  the  Gulf  Stream.  The  meandering  process 
is  described  in  [5],  [8]  and  [12],  with  studies  of  cold-core  rings  appearing, 
among  other  places,  in  [14]  and  [17].  Warm-core  rings  form  in  the  slope 
water  region  between  the  Gulf  Stream  and  the  North  Atlantic  Continental 
Shelf  ([7],  [15]).  They  too  are  roughly  elliptical  in  shape  with  a  diameter 
of  100-200  km.;  a  warm-core  ring  boundary  consists  of  water  similar  to 
the  North  Wall  of  the  Gulf  Stream.  Several  satellite  studies  of  Gulf 
Stream  rings  have  been  made.  Among  them  are  [1],  [2],  [9]  and  [16].  It 
should  be  noted  though  that  the  location  of  ring  centers  from  satellite 
IR  imagery  is  by  no  means  a  simple  task.  Substantial  portions  of  ring 
boundaries  are  often  obscured  by  clouds,  and  though  the  rings  themselves 
tend  to  be  elliptical  in  shape,  there  is  some  variation  and  fuzziness  in 
their  boundaries  as  well  as  some  axial  asymmetry.  This  has  been  observed 
in  several  studies  ([1],  [3],  [4]  and  [11]  among  others).  In  [1]  a 
technique  is  described  for  locating  ring  boundaries  from  digital  IR  satellite 
images.  It  involves  an  analyst  moving  a  cursor  over  the  boundary  and 
recording  coordinates  of  the  resulting  points.  A  least  squares  fit  is  then 
provided  to  a  curve  of  the  form 

ax2  +  2hxy  +  by2  +  2gx  +  2fy  +  c  =  0 

2 

with  h  <  ab.  From  this,  the  center  and  orientation  of  the  ring  can  be 


estimated. 
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Our  goal  in  the  present  report  is  somewhat  different.  A  prototype 
for  the  automatic  detection  of  Gulf  Stream  rings  will  be  described  and 
illustrated.  A  sequence  of  techniques  are  employed,  and  these  are  in¬ 
dividually  described  in  §2: 

A.  Image  smoothing  and  cloud  removal. 

B.  Image  simplification. 

C.  Edge  detection. 

D.  Removal  of  objects  of  the  wrong  size. 

E.  Ellipse  detection. 

Once  a  ring  has  been  located,  more  sophisticated  techniques  may  be  em¬ 
ployed  to  determine  its  center  and  orientation.  Finally,  in  §3,  the 
techniques  will  be  applied  to  some  data  furnished  by  NAVOCEANO,  Code  9110. 
The  image  shows  3  cold-core  rings,  and  comes  from  AVHRR  Band  4  of  Orbit 
9520  of  N0AA-7  (28  April,  1983). 


2.  Description  of  Algorithms.  Corresponding  to  the  5  algorithms 
defined  at  the  end  of  §1,  the  section  will  be  broken  into  5  parts. 

A.  Image  smoothing  and  cloud  removal.  The  cloud  removal  techniques 
will  be  described  elsewhere,  so  let  us  simply  assume  that  we  are  dealing 
with  a  cloud  free  image.  Preliminary  image  smoothing  is  accomplished  by 
2  iterations  of  a  spatial  3  by  3  filter.  A  total  of  40  such  filters  was 
tried,  and  our  goal  here  will  be  to  describe  them.  This  will  be  done  in 
stages,  as  the  filters  themselves  fall  into  roughly  3  different  categories 
The  first  category  represents  variations  of  a  median  and  mean  filter,  and 
here  they  are: 


Filter  No. 


DescriDtion 


Median 

Trimmed  Mean.  Remove  highest  and  lowest  value, 
and  take  mean  of  those  remaining. 

Trimmed  mean,  removing  highest  and  lowest 
two  values. 

*  \  *  ;  0 

Lowest  value  in  window  *■ 


Third  from  bottom  value 
Seventh  from  bottom  value 
Highest  value  in  window 
Mean  of  3  lowest  values 
Mean  of  5  lowest  values 
Mean  of  7  lowest  values 
Mean  of  3  highest  values 
Mean  of  5  highest  values 
Mean  of  7  highest  values 
Straight  3  by  3  mean 
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The  second  category  of  filters  has  its  genesis  in  a  paper  by  Narayanan 
and  Rosenfield  [10].  The  idea  behind  their  operation  is  both  simple  and 
powerful.  Suppose  that  a  digital  image  contains  grey  levels  in  the  range 
from  IMIN  to  IMAX.  Suppose  further  that  some  statistic  S(I)  is  associated 
with  each  grey  level  I,  and  that  S(I)  <  S(J)  implies  that  grey  level  J 
is  somehow  more  reliable  than  grey  level  I.  Though  there  are  other  pos¬ 
sibilities,  one  might  think  of  S( I )  as  being  the  frequency  count  of  I. 
Suppose  the  center  pixel  of  a  3  by  3  neighborhood  has  grey  level  I.  Rather 
than  take  a  straight  mean  of  the  pixels  in  the  neighborhood,  one  selects 
only  those  pixels  that  are  in  some  sense  more  likely  to  have  a  correct 
grey  level  than  does  the  center  pixel.  Method  la  averages  in  those 
pixels  whose  grey  level  J  is  such  that  S(J)  2  S( I ) ;  method  1c  wants 
S(J)  _■  S ( I )  and  |J  -  I|  £  2.  Method  lb  coincides  with  la,  and  Id  with 
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1c,  except  that  if  fewer  than  3  pixels  are  to  be  averaged,  then  the  center 
pixel  is  deemed  noise,  and  the  filter  output  becomes  the  mean  of  the  3  by 
3  neighborhood  with  the  center  pixel  removed.  Method  2a  is  like  la,  except 
that  no  peak  S (k )  is  allowed  with  k  between  i  and  j,  while  2c  is 
like  la  with  at  most  2  peaks  allowed  for  values  between  i  and  j.  Methods 
2b  and  2d  are  the  analogues  of  lb  and  Id.  With  S ( I )  representing  the 
frequency  count  of  level  I,  we  now  have: 

Filter  No.  Description _ 


15 

Method 

la 

16 

Method 

lb 

17 

Method 

1c 

18 

Method 

Id 

19 

Method 

2a 

20 

Method 

2b 

21 

Method 

2c 

22 

Method 

2d 

Two  other  choices  for  the  statistic  S  were  tried.  Option  B  used  the 
negative  of  the  average  standard  deviation  of  3  by  3  neighborhoods  centered 
on  pixels  having  grey  level  I,  while  option  C  represented  the  empirical 
probability  that  a  pixel  that  was  a  neighbor  of  a  pixel  with  grey  level  I 
would  itself  have  grey  level  I  (a  careful  description  of  this  statistic 
occurs  in  [6]).  With  this  scheme,  the  frequency  count  definition  for  S 
could  be  called  option  A.  We  summarize  options  B  and  C  in  a  single  table. 


-5- 


i.- 

i 


i 


Option  B 
Filter  No. 

Option  C 
Filter  No. 

Description 

23 

31 

Method  la 

24 

32 

Method  lb 

25 

33 

Method  lc 

26 

34 

Method  Id 

27 

35 

Method  2a 

28 

36 

Method  2b 

29 

37 

Method  2c 

30 

38 

Method  2d 

The  remaining  two  filters  are  modifications  of  a  median  filter.  In  each 
case,  a  3  by  3  neighborhood  is  rank  ordered  by  grey  level,  with  the  highest 
grey  level  given  rank  1.  Filter  Number  39  outputs  the  rank  4  value  if 
the  center  pixel  rank  _>  4,  the  rank  6  value  if  the  center  pixel  rank  <  6, 
and  the  median  if  the  center  pixel  rank  is  5.  Filter  Number  40  outputs 
the  median  if  the  center  pixel  rank  is  not  4,  5  or  6,  and  otherwise  leaves 
the  center  pixel  unchanged. 

B.  Image  simplification.  Even  after  two  applications  of  a  smoothing 
filter,  an  image  will  usually  be  too  noisy  to  effectively  locate  edges  of 
Gulf  Stream  rings.  A  single  pass  of  a  suitable  image  simplification  al¬ 
gorithm  will  serve  to  rectify  this  problem.  A  careful  and  detailed  descriD- 
tion  of  this  algorithm  occurs  in  [6],  so  we  shall  be  content  with  a  brief 
summary  of  its  operation.  The  input  to  the  algorithm  consists  of  the 
original  image  ORIG  and  a  filtered  version  FIL.  Two  statistics  are 
calculated.  S ( I )  is  the  statistic  for  grey  level  I  that  was  used  in 
Option  C  of  the  filters,  and  it  is  computed  on  FIL.  Further,  for  each 
grey  level  of  I  of  FIL,  one  computes  the  mean  M(I)  of  all  those  pixels 
in  ORIG  whose  filtered  version  in  FIL  has  grey  level  I.  The  grey  levels 
are  rank  ordered  by  S(I)  to  form  a  sequence  I-j  .Ig.. •  •  *1^  with 


y.v.sj 


.V.V.N  . 


.SkV.y 


S(I-j)  £  S ( 1 2 )  i  •••  i.  5(1^).  A  list  of  levels  to  be  deleted  is  now  con¬ 
structed: 

1-|  is  always  deleted. 

I-  is  deleted  provided  neither  I.-l  nor  I.  +  l  has  al- 

J  J  J 

ready  been  deleted. 

This  guarantees  that  adjacent  grey  levels  are  never  simultaneously  deleted, 
so  at  most  half  of  the  grey  levels  in  an  image  are  deleted.  Pixels  in  a 
deleted  grey  level  I  are  assigned  to  that  remaining  level  J  that  minimizes 
I M ( I )  -  M(J ) | . 

C.  Edge  Detection.  A  Kirsch  edge  detector  (as  described  in  [13])  is 
employed.  Its  output  is  then  thresholded  so  as  to  produce  a  binary  edge 
image.  Identical  thresholds  were  used  for  the  various  filter  options. 

D.  Object  Removal .  As  a  further  step  toward  image  simplification, 
any  object  that  is  too  small  to  be  a  ring  is  removed.  The  algorithm  passes 
a  k  by  k  window  over  the  picture.  If  the  outer  edge  of  the  window 
contains  no  edge  elements,  then  the  edge  elements  within  the  window  are 
removed.  A  suitable  choice  for  k  will  leave  any  ring  boundaries  unchanged, 
and  yet  remove  much  of  the  background  clutter  that  is  too  small  to  be  a 
ring. 

E.  Ellipse  Detection.  A  k  by  k  window  (k  an  odd  integer)  is 
passed  over  the  binary  edge  output  that  results  from  applying  C  and  D. 

At  each  position  of  the  window  the  center  pixel  is  tested  to  see  if  it 
could  be  the  center  of  an  ellipse  lying  within  the  window.  Using  polar 
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coordinates  with  the  center  pixel  as  the  origin,  the  rays  0^  =  2-ni/t 
(i  =  0,1,. ...t-l)  are  now  produced  and  the  distances  di  recorded  where 
the  first  edge  element  along  9^  is  found,  with  di  =  0  if  no  edge  ele¬ 
ments  are  encountered  within  the  window.  If  t  is  an  even  integer,  then 
one  may  use  opposite  rays  to  locate  a  major  axis  for  any  potential  ellipse. 

The  minor  axis  is  then  chosen  to  be  the  pair  of  rays  that  are  perpendicular 
to  this  major  axis,  provided  their  "d"  values  are  not  0.  Otherwise,  one 
can  look  at  diameters  close  to  the  perpendicular  to  find  the  length  of  the 
minor  axis.  If  no  minor  axis  can  be  calculated,  the  process  stops  and  an 
error  message  results.  Assuming  that  a  major  and  minor  axis  have  been  cal¬ 
culated,  one  now  simply  predicts  where  each  ray  0^  should  hit  an  edge,  and 
computes  the  sum  of  the  differences  between  the  observed  and  calculated 
values.  Near  an  ellipse  center  this  error  sum  has  a  dramatic  dropoff,  and 
preliminary  work  shows  that  it  is  possible  to  set  a  threshold  that  will 
allow  an  effective  decision  to  be  made  as  to  whether  the  center  pixel  is 
indeed  the  center  of  an  ellipse.  To  compensate  for  errors  in  digitization, 
and  the  fact  that  we  are  looking  at  a  low  resolution  version  of  a  picture, 
it  is  often  useful  to  do  the  above  process  with  d,.  replaced  by  maxfO.d^  -  /?/2). 
Because  of  the  nature  of  the  algorithm,  it  is  convenient  to  represent  an 
ellipse  in  polar  coordinates,  centered  on  the  center  pixel.  The  equation 

b2x2  +  a2y2  =  a2b2 


then  becomes 


222  222  22 
r  b^cos  0  +  r  a  sin  8  =  a  b^ 


and  after  some  routine  algebraic  manipulation,  one  finds  that 


=  b2/[l  +  fcij  -  l]cos20  . 


A  lookup  table  of  values  of  cos  0  now  allows  for  the  rapid  calculation 
of  values  of  r. 

Though  this  is  the  technique  on  which  the  paper  is  based,  it  is  by  no 
means  the  only  method  that  was  tried.  If  one  wishes  to  allow  for  axial 
asymmetry,  for  example,  one  can  fit  4  sections  of  ellipses  together  by 
joining  them  at  the  vertices.  There  are  also  other  candidates  for  errors. 

One  can  use  the  predicted  y-value  of  an  ellipse  instead  of  predicted  ray 
lengths  as  a  means  of  measuring  error  in  fit. 

3.  Applications  to  Real  Data.  The  algorithms  were  tested  on  the  image 
described  on  p.  2.  A  portion  of  this  image  is  displayed  in  Figure  1,  and  it 
contains  3  cold-core  rings.  The  algorithms  were  actually  applied  to  the 
image  displayed  at  the  top  of  Figure  2.  This  represents  a  subimage  of 
Figure  1  containing  the  rings.  This  subimage  was  reduced  by  a  factor  of  2 
in  both  the  horizontal  and  vertical  directions,  so  that  what  is  displayed 
contains  84  rows  and  139  columns.  The  bottom  image  of  Figure  2  is  the  out¬ 
put  of  a  Kirsch  edge  detector  on  the  top  image.  It  illustrates  the  need  for 
some  image  smoothing  and  image  simplification  before  any  attempt  can  be 
made  to  detect  elliptical  objects.  Figures  3-7  contain  the  final  output 
corresponding  to  each  of  the  40  filter  techniques.  The  9  images  in  Figure  3 
represent  the  outputs  of 

Filter  1  Filter  2  Filter  3  (Row  1) 

Filter  4  Filter  5  Filter  6  (Row  2) 

Filter  7  Filter  8  Filter  9  (Row  3) 

In  a  similar  fashion.  Figure  4  depicts  Filters  10-18,  Figure  5  Filters  19-27, 
Figure  6  Filters  28-36,  while  Figure  7  contains  Filters  37-40. 
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Though  it  is  clear  that  no  conclusions  may  be  drawn  from  a  single 
image,  one  can  still  observe  that  the  most  promising  filters  are: 
1,2,3,14,15,16,17,18,19,20,21,22  and  40.  These  filters  represent  mean 
filters,  trimmed  means,  medians,  and  the  global  information  filters  proposed 
in  [10].  Much  more  work  needs  to  be  done  before  any  meaningful  conclusions 
can  be  drawn.  Changes  in  thresholding  of  the  filtered  images,  for  example, 
will  produce  dramatic  differences  in  the  final  output,  as  will  modifications 
of  the  image  simplification  algorithm.  Even  so,  when  the  ellipse  detection 
algorithm  is  applied  to  images  such  as  those  that  resulted  from  Filters  1,2 
or  3,  the  result  was  the  correct  detection  of  the  3  cold-core  rings  with  no 
false  ring  detections  of  any  kind.  To  illustrate  this,  we  present  the 
results  obtained  by  applying  the  ellipse  detector  to  the  output  of  Filter  1. 

The  program  used  rays  in  a  43  by  43  window  centered  on  alternate  rows  and 
columns.  The  goodness-of-fit  statistic  was  computed  only  if  the  program 
decided  that  the  center  pixel  was  not  close  to  an  edge  point,  and  that  a 
sufficient  number  of  rays  intersected  edge  points.  A  total  of  24  rays  were 
used  for  the  following  data,  but  similar  results  were  obtained  using  only 
16  rays.  The  program  correctly  detected  centers  of  rings  at  positions  (35,82), 
(60,116),  and  (62,35),  where  the  symbol  (I,J)  denotes  the  I-th  row  from 
the  bottom  and  the  J-th  column  from  the  right  of  the  image. 


Row  Number 


Column  Number 


text  for  explanation) 


Filters  37-^0  (See  text  for  explanation) 
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